MULTIMEDIA QUERY SYSTEM USING NON-UNIFORM BIN QUANTIZATION 

OF COLORA HISTOGRAM 



BACKGROUND OF THE INVENTION 

i-r^Md l . Field of the Invention 

[] The present invention generally relates to a multimedia query using 

acolor hiGtogram, and more particularly, to a m e thod for configuring a color histogram which 
provid e s interop e rability b e tween color histograms configur e d by non uniform bin quantization 
using bits of a different numb e r, and provid e s progressive bit procossingfor keeping a constant 
performance e ven when using the front parts of total bits of each bin valu e in th e ord e r of tim e 
s e ri e s. 



2. D e scription of the Relat e d Art 

R e cently, a s content based multimedia qu e ry techniqu e s ar e coming to th e front, th e 
study of multimedia features affecting a query performanc e is being mad e actively. Most 
frequ e ntly used s e arch engines at pr e sent us e global and local color information and textur e 
information for imago retri e val. i\mong them, the color information is Icnown as an element 
mostly affecting th e image retrieval. Thus, the d e v e lopment of mor e e ff e ctive color features is 
b e ing made, and also an attempt to d e v e lop color spac e s more e ff e ctiv e to th e r e trieval is b e ing 
mad e . 

A color histogram is most widely us e d as color information. The color histogram is 
information representativ e of color distribution of multim e dia data such as imag e s. A bin numb e r 
of th e histogram is det e rmined according to how th e color spac e is quantiz e d. Although e ach bin 
valu e is reprosonted by a d e cimal mostly, it also can b e r e pr e sent e d by N bits small e r than a 
fractional repr e sentation spac e for more improved p e rformance and spatial e ffici e ncy. For 
exampl e , it is gen e rally laiown that spaces can b e saved substantially without d e gradation of 
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performance by r e pres e nting 8 bits, i. e ., docimals b e tw ee n 0 and 1, by 256 kinds of valu e s. In a 
unifonn quantization m e thod, values betw ee n 0 and 1 ar e divid e d by a uniform width, quantized 
and repr e sented, whil e , in a non uniform quantization m e thod, th e y ar e divided by a non uniform 
width, quantiz e d and r e present e d. 

In cas e of using the non uniform quantization method, it is possibl e to impl e m e nt an 
improv e d p e rformanc e as compar e d to th e case of using th e uniform quantization m e thod or 
r e pr e s e nting a d e cimal as it is. For instanc e , a s e ction of an important bin valu e is divid e d mor e 
finely, while a section of a valu e having no division ability is divided less fin e ly, for th e reby 
e nhancing th e p e rformanc e . For e xampl e , in cas e of a histogram, most bin valu e s consists of a 
numb e r smaller than 0.2, and thus it is m e aningl e ss to divid e a numb e r mor e than 0.2 fin e ly. For 
this r e ason, th e bin quantization using non uniform quantization can b e employed v e ry us e fully, 
but it may lead to the following probl e ms. 

Problem of interop e rability : Firstly, it is difficult to compar e bin valu e s each quantiz e d 
by a diff e rent number. For e xampl e , a certain histogram quantizes and r e pres e nts a bin value by 
2^^ -16 in ord e r to r e pr e sent e ach bin valu e by 4 bits, whil e anoth e r histogram quantiz e s a bin 
valu e by 2^- 4 in ord e r to r e pr e s e nt e ach bin valu e by 2 bits. Th e n, th e comparison of th e s e values 
i s made impossibl e if there is no information about th e m e thod for quantization of each bin 
valu e . Th e r e fore, it is n e c e ssary to e nsur e int e roperability by which th e comparison of bin valu e s 
quantiz e d by a differ e nt number by using a quantization m e thod conforming to a particular 
protocol. 

1. Problem of progres s ive bit proces s ing: when a color hi s togram is tran s ferred 
through a network, it can be tran s ferred in the order of bin s according to the 
coding schem e of the color hi s togram, or in the order of bit s of the bin. In ca se 
of transferring the color hi s togram in the order of bins, every bit s of the fir s t 
bin are transferred and thereafter the next bin is tran s ferr e d. In ca se of 
transf e rring the color hi s togram in the order of bits, th e fir s t bit of the first bin 
is transferred and then the fir s t bit of the s econd bin is transferred. In thi s way, 
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aft e r e v e ry first bits repre s enting each bin value are tran s ferred, every second 
bit s representing each bin valueare tran s ferred. In s uch a coding s cheme, if the 
tran s fer is interrupted before the hi s togrom i s completely tran s ferred, the 
compari s on of the hi s togram ha s to be enabled only by the tran s ferred part of 

the histogram. 

SUMMARY OF THE INVENTION 

It is, th e r e for e , an obj e ct of th e pr e s e nt inv e ntion to provide a multim e dia qu e ry using a 

color histogram which e nables comparison b e tw e en histograms non uniform bin quantiz e d by a 
diff e rent number of bits, and also e nabl e s comparison b e tw ee n histograms by using th e front 
parts of the histogram in th e order of transf e r when th e histogram is transf e rr e d in th e ord e r of 

To achieve th e above obj e ct, a color hi s togram in accordance with th e pr e s e nt inv e ntion 
is provid e d, which compris e s thr e shold valu e s us e d in r e pr e s e nting the numb e r of n of bits for 
s e curing interop e rability, capable of comparing the histograms r e pres e nt e d by bits of a diff e r e nt 
numb e r, including n e c e ssarily tlir e shold valu e s u se d in r e pr e s e nting th e number of N'(N'<N) of 
bits, wh e n bin valu e is r e pr e s e nt e d w^ith th e numb e r of N of bits by quantization in ord e r to query 
multim e dia using color hi s togram. 

In addition, th e re is provid e d a multim e dia qu e ry m e thod in accordance with th e pr e s e nt 
inv e ntion, which comprises the st e ps of: correcting the oth e r bin valu e as small e r number of N of 
bits and th e n comparing two valu e s, if on e of two histograms r e pres e nts bin value with M, the 
oth e r r e pr e s e nts bin valu e with N(M>N), wh e n p e rforming th e comparison b e tw ee n histograms 
r e pr e s e nt e d with th e numb e r of bits which ar e diff e r from e ach oth e r. 

Pr e f e rably, th e r e is provid e d a multimedia qu e ry m e thod in accordanc e with th e present 

inv e ntion, wherein th e corr e cting is p e rform e d by adding th e bin valu e s divid e d by the thr e shold 

valu e s (THls) e xisting b e tw e en two thr e shold valu e s us e d in r e pr e s e nting th e number of N of 

bits to th e r e st threshold values e xc e pt for thr e shold values (TH2s) us e d in r e pr e senting the 
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numb e r of N of bits, among throshold valu e s (THls) us e d in roprosonting th e numb e r of M of 
bitsr 

In addition, th e re is provid e d a color histogram quantization m e thod in accordanc e with 
the pr e sent inv e ntion, which comprises th e st e ps of: dividing HMMD color spac e by a color 
histogram, th e color histogram comprising threshold valu e s used in repr e s e nting th e numb e r of n 
of bits for s e curing int e rop e rability, capabl e of comparing th e histograms r e pr e s e nt e d by th e 
numb e r of bits which ar e diff e r from each oth e r, including n e cessarily thr e shold valu e s us e d in 
r o prosenting th e numb e r of N'(N'<N) of bits, wh e n bin valu e is repr e s e nted with th e number of 
N of bits by quantization in ord e r to qu e ry multim e dia using color histogram, at this tim e , (a) 
producing index e s of two bin valu e s by using a threshold valu e 2.5/310.0 for r e pr e s e nting 1 bit 
bin valu e ; (b) producing ind e xes of four bin valu e by using thr ee thr e shold valu e s 2.5/310.0, 
9.1/310.0, and 30.0/310.0 for r e pr e s e nting 2 bits bin values; (c) producing 16 ind e x e s by 
d e ciding 0.0 of bin valu e as an ind e x for r e pr e senting 4 bits bin values, producing two ind e x e s by 
bis e cting a period of 0 and' 0.6/310.0, producing an index in th e p e riod of 0.6/310.0 and 
2.5/310.0, producing fiv e ind e x e s in th e p e riods of 2.5/310.0 and 19.0/310.0, producing six 
indexes in tho p e riods of 19.0/310.0 and 85.0/310.0, and designating the value above 85.0/310.0 
as an index; and (d) producing an index by d e ciding 0.0 of bin value as an ind e x for r e pr e s e nting 
6 bits bin valu e s, producing four ind e x e s by diving a p e riod of 0 and 0.6/310.0 into four e qual 
parts, producing four ind e x e s by diving the period of 0.6/310.0 and 2.5/310.0 into four e qual 
parts, producing t e n ind e x e s by dividing the p e riods of 2.5/310.0 and 19.0/310.0 into t e n e qual 
parts, producing thirty indexes by dividing the p e riods of 19.0/310.0 and 85.0/310.0 into thirty 
e qual part s , producing fourt ee n ind e xes by dividing th e periods of 85.0/310.0 and 121.0/310.0 
into fourteen e qual parts, and d e signating th e value above 121.0/310.0 as an ind e x. 

In addition, th e r e is provid e d a color histogram in accordanc e with the pr e s e nt inv e ntion, 
which comprises n th bit r e pr e s e nt e d by quantization of bin valu e , wher e in tho nth bit bis e cts th e 
r e spective r e gions divid e d into (N - l)th bit in ord e r to p e rform a progressiv e bit proc e ssing 
capabl e of r e tri e ving by using only a bit, wfech is small e r than N, when bin valu e is r e pr e s e nt e d 
with the number of N of bits by quantization in ord e r to qu e ry multim e dia using color histogram. 

Pr e ferably, ther e is provided a color histogram encoding m e thod in accordanc e with tho 
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pr e s e nt inv e ntion, which compris e G th e steps of: arranging firstly th e first bit of e very bin; and 
arranging th e s econd bit, wh e n e ncoding th e histogram r e pr e senting bin valu e capabl e of a 
progr e ssiv e bit proc e ssing. 

Pr e f e rably, th e r e is provid e d a multim e dia qu e ry syst e m in accordanc e with th e pres e nt 
inv e ntion in which only a portion of the histogram is us e d according to th e use of query and 
e nvironm e nt of a client, th e r e by capabl e of p e rforming the optimum qu e ry. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The abov e obj e cts, f e ature s and advantag es of th e pr e s e nt inv e ntion will b e come mor e 

apparent from th e following d e tailed d es cription wh e n tak e n in conjunction with th e 
accompanying drawings, in which: 

Fig. 1 is a vi e w e xplaining an e xampl e of bin quantization which is int e rop e rable; 

Fig. 2 is a view e xplaming a phas e in which multim e dia data r e pres e nt e d as a color 

histogram ar e transf e rr e d in the ord e r of bit priority; 

Fig. 3 is a vi e w e xplaining a partial query using a color histogram of which transfer is 

int e rrupt e d; 

Fig. 4 is a view e xplaining th e r e lationship betw ee n a thr e shold and color histogram data; 

Fig. 5 i s a view illu s trating a HMMD color s pace to which th e pr e sent invention is 

adapted; and Z Background of the Related Art 

1 P Images or pictures can be stored on a computer in digital form. Utilizing 

digital images is becoming increasingly popular. This popularity may be attributed to the low 
cost of producing digital images as compared to images taken with a conventional camera 
using film. One advantage is digital images can be distributed electronically via the Internet. 
Another attribute is that there is no incremental cost per image to produce the digital image 
by digital camera. Accordingly, a user of a digital camera may tend to take many pictures. 
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Further, there is an enormous amount of digital images available to users via the Internet It 
is often a great task for a user to locale a digital image through a search. Accordingly, search 
engines exist for searching for digital images. However, these search engines suffer from at 
least two disadvantages. One disadvantage is that not all images are represented in the same 
way for purposes of the search. For example: two images may be represented by a 
histogram for searching purposes, however the histograms utilize different protocols which 
are not compatible. Another disadvantage is that data relating to an image (i.e., a histogram) 
may be only partially transferred between computers on a network and cause that partial 
transfer of the histogram to be useless. 

SUMMARY OF THE INVENTION 

2 0 

Objects of the present invention at least include overcoming the above-discussed 
disadvantages. Particularly, embodiments of the present invention allows for increased 
compatibility between two histograms and allows for a portion of a histogram to be utilized 
in a query. 

3 [] Embodiments of the present invention relate to a method for recei\dng a first 

sequence of values and a second sequence of values. Each value in the first sequence and 
each value in the second sequence is associated with a category and a magnitude. In 
embodiments of the present invention, the magnitudes are thresholds. In embodiments of 
the present invention the categories are bins. In embodiments of the present invention each 
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value of a sequence is a bit. In the order of the values of both the first sequence of values 
and the second sequence of values, no adjacent values have the same category. Accordingly, 
in embodiments of the present invention, when a histogram is transferred or received for 
analysis, the order of the information in the histogram can be strategically ordered to 
increase compatibility of histograms and utilize partials of histograms in an image search. 

4 P In particular, when a histogram is transferred, bits are ordered or given a 

priorit)^ of the placement of the bits over the categon^ that the bit is in. For example, when a 
histogram is transferred, the first bit of every categor\^ is transferred for the second bit of 
every categon^ In embodiments of the present invention, since each bit in the order of bits 
in each categon^^ is associated with a different magnitude, compatibility can be accomplished. 
Further, since bits are transferred according to magnitude and not according to a category, 
the initial bits of a transferred histogram can be utilized without needing the remainder of 
the bits. 

5 P Additional advantages, objects, and features of the invention wiU be set forth 

in part in the description which follows and in part will become apparent to those having 
ordinan- skill in the art upon examination of the following or may be learned from practice 
of the invention. The objects and advantages of the invention may be realized and attained 
as particularly pointed out in the appended claims. 



BRIEF DESCRIPTION OF THE DRAWINGS 
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Fig. 1 is a view explaining an example of bin quantization which is interoperable. 

7 P Fig. 2 is an exemplan^ view explaining a phase in which multimedia data 

represented as a histogram are transferred in the order of bit priorit}^ 

8 Q Fig. 3 is an exemplary view explaining a partial query using a histogram of 

wliich transfer is interrupted. 

9 [I Fig. 4 is an exemplar}^ view explaining the relationship between a threshold 

and histogram data. 

4410 0 Fig. 5 is an exemplan^ view illustrating a HMMD color space. 

4^11 Fig. 6 i s Q view explaining a 1 84 lev e l quantization method view e d in a MMD fl 

Fig. 6 is an exemplan^ view explaining a 184 level quantization method viewed in a 

HMMD cross-section. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

4^12 0 

A method for configuring a color histogram non uniform bin quantized and T he following 
detailed description of embodiments of the present invention depicts only histograms for 
the purpose of exemplary iQustrating the method of a multimedia query using the histogram. 
The present invention can be equally effective when applied to other t\^pes of histograms. 
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13 color hi s togram in Qccordancc with Q Search engines may use global and local 
color inFormarion and texmre information for image retrieval. Among them, the color 
information is an important element in effective image quer\^ Embodiments of the present 
invention relate to a color histogram. A histogram is a chart representing color distribution 
in multimedia data (i.e.. images). A category or bin number of a histogram is determined 
according to how a given color space is quantized. Although each bin value may be 
represented by a decimal, it also can be represented by a quantit\^ of N bits smaller than a 
fractional representation space. For example, it is generally known that spaces can be saved 
substantially without degradation of performance by representing 8 bits, i.e.. decimals 
between 0 and 1. by 256 kinds of values. In a uniform quantization method, values between 

0 and 1 are divided by a uniform width, quantized and represented, while, in a non-uniform 
quantization method, they are divided by a non-uniform width, quantized and represented. 

14 [] In non-uniform quantization, it is possible to achieve improved performance. 

For instance, a section of an important bin value can be divided more finely than a section 
having a bin value having no divisability. For example, in case of a histogram, most bin 
values consists of a number smaller than 0.2. and thus it is meaningless to di\tide a number 
more finely than 0.2. In this example, bin quantization using non-uniform quantization can 
be effectively employed. 

1 S having two objects [] Embodiments of the present invention overcomes problems of 
interoperability among histograms. It may be difficult to compare bin values that are 
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quantized by a different numher For example, if a certain histogram quantizes and 

represents a bin value hv 2-*= 16 in order to repres e nt each hin value hv 4 hits, while another 

histogram quantizes a bin value h v 2^=4 in order to represent each bin value hv ? hitf; 

Then, the comparison of these values is impossi b le, because there is no informarion ahont 

die method for quantization of e ach bin value. Therefore, to ensure interoperability a 

quantization method, used by the t wo histograms, must conform to a particular p rnrnrnl 

U Embodiments of the present invention overcomes problems in 

progressive bit processing w ill now hn HRr-nrihoH 

4;^! 6of histogra ms. Fo r exam p le, when a histogram is transferred through a netAvork. it can 
be transferred in the order of bins a ccording to die coding scheme of the histog ram or in the 
order of bits of die bin. Fir s tly, ochicvcmcnt of interoperability^ in occordancc with the 
pre s ent invention will be explained. When a histogram is transferred in the order of bins , 
every bit of the first bin are trans ferred and then even^ bit of the next bin is transferred 
mien a histogram is transferred in t h e order of hits, the first bit of the first bin is transferred 
and then the first bit of die seco nd bin is transferred. For instance, after every first bit 
representing each bin value are tran sferred, every second bit represenrine each bin value are 
transferred. In such a coding sche m e, if the transfer is interrupted before tJie histogram is 
completely transferred, the comp a rison of the histogram has to be enabled only by the 
transferred part of the histogram. 

U With respect to histo gram infofmation of multimedia data, a 

color space can be quantized diffe rently for variouo usos different purposes. Likewise, 
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a bin value can be quantized differently for v arieu sdifferent methods for representing 
each bin value. For example, in a particular application^ 4 bits w iW-be are adequate for 
representing a bin value, while, in another application^ at least 8 bits w iti-beare 
adequate for the corresponding use. In order to calculate similarity between those 
a pplications, it is necessary to ensure the result of the comparison between them 
using at least the same 4 bits. However^ in the non-uniform quantization, there are 
various quantization methods, so it is possible to compare them when the different 
quantization methods are e mployed. 

4^1 7employed. Accordingly, ^ embodiments of the present invcntion a nvention relate to a 
method for quantizing a bin value to enable interoperability between them — is 
sugge s tcd. histograms. 

18 [I Fig. 1 is a view explaining an example of bin quantization, which is 

interoperable. In 101 of Fig. 1, a bin value is represented as 0 or 1 based on a particular 

threshold THl for 1 bit representation. A histogram represented by such a method and 2 

bit representation capable of direct comparison are described in 102 of Fig. 1. That is, a bin 

value is represented in four ways by using the threshold THl described in 101 of Fig. 1 and 

another two thresholds TH2 and TH3. In case of compari s on with a hi s togram repre s ent e d 

by 1 bit. two additional thresholds (TH2 and TH3). Comparison between histograms 101 

and 102 are possible, since the threshold THl u s ed in the 1 bit representation method is 

included o s it i s ^ the 2 bit r e presentation can be is used in both histograms. 

corrected in the sam e way as th e 1 bit r e pr e s e ntation by simply adding anoth e r parts. In 
. this oxamplo, the total sum of ooction 2 102b, section 3 102c and s e ction 1 102d of four s e ctions 
102a, 102b, 102c and 102d will bo th e same as the representation of 101. In this way, when a 
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section is quantized mor e fin e ly by uoing e very thresholds us e d in dividing th e histogram into 
small e r s e ctions and anoth e r thresholds, e v e n bin values r e presented by a diff e r e nt number of 
bits can be corr e cted and th e n compared by representation using bits of a small e r number. 
19 Ncxt, according to the present invention, progressive bit proce s sing will now be 

de s cribed. Fig. [] Fig. 2 is a view explaining a phase in which multimedia data 

represented a s a color hi s togram arc transferr e d in the order of bit priority. exemplary 

embodiments of the present invention. As shown in the drawing, a coding scheme can be 

considered in which a first bit of every bins (bin 1 bin N) is transferred and then a second 

bit of ever}' bit is transfetred. In other words, in instead of all the bits of a bin i s 

tran s ferred, not in th e ord e r of bins^, in tran s ferring a color histogram. In thi s method, in 

th e case being transferred together, all the bits having the same association in the bins are 

transferred together. In the event that transfer is interrupted before the completion of the 

transfer as shown in Fig. 3, query can be executed only by transferred parts. 

At this time, in [] In order to assure a certain degree of performance^ 

when each bin is quantized by n bits and represented, it is necessary to represent 
optimum information which can be represented by each bit in the order of bits. For 
this purpose, the case of quantizing a bin value will be considered as follows. Firstly, 
assuming that a bin value is represented by 1 bity one optimized threshold will be 
used to show the highest performance when the bin value is represented by two 
values, i.e.y Q or 1. In addition, in case of representing the bin value by 2 bitSy three 
optimized thresholds will be used to show the highest performance when the bin 
value is represented by four values. At this time, if only one bit of two bits can be 
used, the best performance can be expected when the optimized performance 
achieved at the above-described 1 bit representation is obtained. Therefore, in case 
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of representing the bin value by 2 bits^ one of the three thresholds must be a 
threshold used in representing the bin value by 1 h i^ 

20bit In other words, the first bit of cven'^ bin must be associated with the same first 
threshold value. Accordingly, the second bit of a bin is also associated with the same second 
threshold value. This relationship of position in a bin and associated threshold continues 
throughout subsequent bits in each of the bins in a histogram. 

03:21 W In addition, the first bit indicates division of a value based on the above- 
described threshold of 1 bit as shown in Fig. 4. The second bit indicates division of the 
section of the value divided by the first bit In this way, a n-th bit indicates division of each 
section divided by a (N-l)-th bit 

3^22 W In other words, as showft illustrated in Fig. 4, if a bin value is represented by 1 

bit in 401, it is divided based on a threshold Thl. If the bin value is represented by 2 bits in 
402, each of sections divided by the threshold Thl is divided again by the previously used 
threshold Thl and another thresholds Th2 and Th3. If the bin value is represented by three 
bits in 403, each of sections divided by the previously used thresholds Thl, Th2 and Th3 
and another thresholds Th4, Th5, Th6 and Th7. In this manner, when the bin value is 
quantized and represented by a small number of bits so that progressive bit processing can 
be achieved, a certain degree of query performance can be assured by using only transferred 
parts even though transfer is interrupted during the transfer of a histogram. Moreover, bin 
values of the histogram can be queried by using only parts of total bits according to the use 
of the query. At thi s time, in the present invention, even though parts of total bits ar e 
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»j>edx These embodiments they repre s ent cvcn^ information of the entire color bin s and thu s 
n gnnri porfnrmnnpo can be oxpoctcd. of the present invention allow for adequate gutty 
performance, even though all bits of a histogram ate not utilized. 

3423 Q Fig. 5 describes a HMMD color space for explaining a progressiveeeler 

histogram using the HMMD color space in accordance with the cmbodimentembodiments 

of the present invention. The HMMD color space is a color space of a double cone shape. 

The HMMD color space is described in U.S. Application Serial Nos. 09/239 J73 filed April 

29. 1999 and 09/865.459 filed May 29. 2001. which is assigned to th e same entit\^ and the 

entire disclosure thereof is incorporated herein by reference. T he central axis thereof is 

represented as SUM ([MAX(RGB) + MIN(RGB)]/2), which corresponds to brightness. 

Fineness is increased in the order of center to peripheral sides of the cone, which is 

represented as DIFF(MAX(RGB)-MIN(RGB)). The angle of the cone indicates a color, 

which is generally represented as Hue. 

[] Fig. 6 illustrates an example of 184 level quantizatio n of the 
HMMD color space explained in Fig. & t 

a§245. As shown in Figure 6, first, a region is divided into 5 partial regions on the basis of 
DIFF and then subdivided on the basis of HUE and SUM again, thereby representing 184 
partial regions in all. These produce aeoler histogram constituted by 184 bins, respectively, 
as follows. First, indexes of two bin values by using a threshold value 2.5/310.0 for 
representing 1 bit bin value are produced. Thereafter, indexes of four bin values by using 
three threshold values 2.5/310.0, 9.1/310.0, and 30.0/310.0 for representing 2 bits bin 
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values are produced. Also, 16 indexes by deciding 0.0 of bin value as an index for 
representing 4 bits bin values, producing two indexes by bisecting a period of 0 and 
0.6/310.0, producing an index in the period of 0.6/310.0 and 2.5/310.0, producing five 
indexes in the periods of 2.5/310.0 and 19.0/310.0, producing six indexes in the periods of 
19.0/310.0 and 85.0/310.0, and designating the value above 85.0/310.0 as an index are 
produced. On the other hand, an index by deciding 0.0 of bin value as an index for 
representing 6 bits bin values, producing four indexes by diving a period of 0 and 0.6/310.0 
into four equal parts, producing four indexes by diving the period of 0.6/310.0 and 
2.5/310.0 into four equal parts, producing ten indexes by dividing the periods of 2.5/310.0 
and 19.0/310.0 into ten equal parts, producing thirty indexes by dividing the periods of 
19.0/310.0 and 85.0/310.0 into thirty equal parts, producing fourteen indexes by dividing 
the periods of 85.0/310.0 and 121.0/310.0 into fourteen equal parts, and designating the 
value above 121.0/310.0 as an index is produced. 

25 n Embodiments of the present invention relate to a 

histogram, The histogram may include the following 

attributes . Threshold values used in representing the 

number of n of bits for securing interoperability, capable 
of comparing the histograms represented by the number of 
bits which are differ from each other, including threshold 
values used in representing the number of (N' <N) of bits, 
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when bin value is represented with the number of N of bits 
by quantization in order to query multimedia using 
histogram. The histogram is a histogram. 

26 [] Embodiments of the present invention relate to a 
multimedia query method. The method may include correcting 
the other bin value as smaller number of N of bits and then 
comparing two values if one of two histograms represents 
bin value with M, the other represents bin value with 
N(M>N) , when performing the comparison between histograms 
represented with the number of bits which are differ from 
each other. The correcting process may be performed by 
summing the bin values divided by the threshold values 
(THls) existing between two threshold values used in 
representing the number of N of bits to the rest threshold 
values except for threshold values (TH2s) used in 
representing the number of N of bits, among threshold 
values (THls) used in representing the number of M of bits. 
The histogram may be a histogram. 

27 [] Embodiments of the present invention relate to a 
histogram quantization method. The method may comprise the 
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following steps. Dividing HMMD color space by a histogram, 
the histogram comprising threshold values used in 
representing the number of n of bits for securing 
interoperability, capable of comparing the histograms 
represented by the number of bits which are differ from 
each other, including necessarily threshold values used in 
representing the number of (N^ <N) of bits, when bin value 
is represented with the number of N of bits by quantization 
in order to query multimedia using histogram, at this time. 
Producing indexes of two bin values by using a threshold 
value 2.5/310.0 for representing 1 bit bin value. 
Producing indexes of four bin values by using three 
threshold values 2 . 5/310 . 0 , 9 . 1/310 . 0 , and 30-0/310-0 for 
representing 2 bits bin values. Producing 16 indexes by 
deciding 0.0 of bin value as an index for representing 4 
bits bin values, producing two indexes by bisecting a 
period of 0 and 0.6/310.0, producing an index in the period 
of 0.6/310-0 and 2.5/310.0, producing five indexes in the 
periods of 2.5/310.0 and 19.0/310.0, producing six indexes 
in the periods of 19.0/310.0 and 85.0/310.0, and 
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designating the value above 85.0/310.0 as an index. 
Producing an index by deciding 0.0 of bin value as an index 
for representing 6 bits bin values, producing four indexes 
by diving a period of 0 and 0.6/310.0 into four equal 
parts, producing four indexes by diving the period of 
0.6/310.0 and 2.5/310.0 into four equal parts, producing 
ten indexes by dividing the periods of 2.5/310.0 and 
19.0/310.0 into ten equal parts, producing thirty indexes 
by dividing the periods of 19.0/310.0 and 85.0/310.0 into 
thirty equal parts, producing fourteen indexes by dividing 
the periods of 85.0/310.0 and 121.0/310.0 into fourteen 
equal parts, and designating the value above 121.0/310.0 as 
an index . 

28 [] Embodiments of the present invention relate to a 
histogram. The histogram includes n-th bit represented by 
quantization of bin value, wherein the nth bit bisects the 
respective regions divided into (N-l)th bit in order to 
perform a progressive bit processing capable of retrieving 
by using only a bit, which is smaller than N, when bin 
value is represented with the number of N of bits by 
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quantization in order to query multimedia using histogram. 
The histogram may be a histogram, 

2 9 [] Embodiments of the present invention relate to a 

histogram encoding method. The method may include 

arranging the first bit of every bin first and then 
arranging the second bit, when encoding the histogram 
representing bin value to perform the progressive bit 
processing . The histogram may be a histogram, 

^30 [I In the present invention, in a multimedia query using aeotef histogram, free 
comparative query between every servers on the internet, not one server, is enabled by 
providing interoperability by which comparative query between histograms bin quantized by 
different number of bits, when considering spatial efficiency by representing a bin value by 
bits of a decimal. In addition, when the bin value is quantized and represented by a limited 
number of bits, a certain degree of query performance can be expected by executing query 
using only parts of the bits, for thereby enabling query at the time of transfer interrupt 
caused by a problem on a network and performing a query service conforming to the use of 
the query or the environment of a client. 



What Is Claim e d Ig: 

1 . A color hiGtogram comprising; 

threshold values us e d in r e pr e s e nting th e numb e r of n of bits for s e curing 
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intoroporability, capabl e of comparing tho histograms repr e s e nt e d by tho numb e r of bits which 
arc differ from each oth e r, including n e cessarily thr e shold valu e s used in repr e senting th e 
numb e r of N'(N'<N) of bits, wh e n bin value is r e pr e s e nt e d with th e number of N of bits by 
quantization in ord e r to qu e r>^ multimedia using color histogram. 

2. A multimedia qu e ry m e thod comprising the st e ps of: 

correcting tho oth e r bin valu e as small e r numb e r of N of bits and th e n comparing two 
values if one of two histograms r e pr e s e nts bin valu e with the oth e r repr e s e nts bin valu e with 
N(M>N), wh e n p e rforming th e comparison betw ee n histograms represent e d with th e numb e r of 
bits which are diff e r from e ach other. 

3. Tho multimedia query method according to claim 2, wherein th e correcting proc e ss is 
perform e d by adding the bin valu e s divid e d by th e thr e shold valu e s (THls) existing betw e en two 
thr e shold values us e d in r e pr e s e nting th e numb e r of N of bits to th e rest thr e shold values e xc e pt 
for thr e shold vaki e s (TH2s) us e d in repr e senting th e numb e r of N of bits, among threshold values 
(THls) us e d in repr e s e nting th e numb e r of M of bits. 

4 . A color histogram quantization m e thod comprising th e st e ps of: 

dividing HMMD color space by a color histogram, th e color histogram comprising 
threshold valu e s used in r e presenting the numb e r of n of bits for s e curing interop e rability, 
capable of comparing the histograms r e pres e nt e d by the number of bits which ar e differ from 
each oth e r, including n e c e ssarily threshold values usod in r e pr e senting th e number of N'(N'<N) 
of bits, when bin value is represented with the numb e r of N of bits by quantization in ord e r to 
query multim e dia using color histogram, at this tim e , 

(a) producing ind e x e s of two bin valu e s by using a threshold value 2.5/310.0 for 
r e pr e s e nting 1 bit bin valu e ; 

(b) producing ind e xes of four bin valu e s by using thr e e thr e shold values 2.5/310.0, 
9.1/310.0, and 30.0/310.0 for representing 2 bits bin values; 

(c) producing 16 indexes by deciding 0.0 of bin value as an index for repres e nting ^ 
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bits bin valu e s, producing two indexeG by bis e cting a p e riod of 0 and 0,6/310.0, producing an 
ind e x in th e period of 0.6/310.0 and 2.5/310.0, producing fiv e ind e x e s in th e p e riods of 2.5/310.0 
and 19.0/310.0, producing six indexes in the p e riods of 19.0/310.0 and 85.0/310.0, and 
d e signating th e value abov e 85.0/310.0 as an index; and 

(d) producing an ind e x by d e ciding 0.0 of bin valu e as an ind e x for repr e s e nting 6 
bits bin valu e s, producing four ind e x e s by diving a period of 0 and 0.6/310.0 into four equal 
parts, producing four ind e x e s by diving th e p e riod of 0.6/310.0 and 2.5/310.0 into four e qual 
parts, producing t e n index e s by dividing th e p e riods of 2.5/310.0 and 19.0/310.0 into t e n e qual 
parts, producing thirty ind e x e s by dividing th e p e riods of 19.0/310.0 and 85.0/310.0 into thirty 
e qual parts, producing fourte e n ind e x e s by dividing th e p e riods of 85.0/310.0 and 121.0/310.0 
into fourte e n e qual parts, and d e signating th e valu e above 121.0/310.0 as an ind e x. 

5. A color histogram comprising; 

n th bit r e pr e s e nt e d by quantization of bin value, wh e r e in th e nth bit bis e cts th e 
r e sp e ctiv e r e gions divid e d into (N l)th bit in ord e r to p e rform a progressiv e bit proc e ssing 
capabl e of r e tri e ving by using only a bit, which is small e r than N, wh e n bin valu e is represented 
with th e numb e r of N of bits by quaiitization in ord e r to qu e ry multim e dia using color histogram, 

6. A color histogram e ncoding m e thod comprising th e st e ps of: 

arranging the first bit of e very bin first and th e n arranging th e s e cond bit, wh e n e ncoding 
th e histogram repr e s e nting bin value to p e rform th e progr e ssiv e bit proc e ssing. 
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Z P The foregoing embodiments and advantages arc merely exemplary and 

are not to be construed as limiting the present invention. The present teaching 
can be readily applied to other t\^pes of apparatuses. The description of the 
present invention is intended to be illustrative, and not to limit the scope of the 
claims. Many alternatives, modifications, and variations will be apparent to those 
skilled in the art. 
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WHAT IS CLAIMED IS: 



1. A method comprising: 

receiving a first sequence of values and a second sequence of values, wherein: 

each value of the first sequence and each value of the second sequence 

is associated with a category and a magnitude, and 

in the order of values of both the first sequence of values and the 

second sequence of values, no adjacent values have the same categor^^ 

2. The method of claim 1. comprising comparing a value of the first sequence with a 
value of the second sequence if the value of die first sequence and the va lue of the second 
sequence are associated with the same categon^ and same magnitude. 

3. The method of claim 1. wherein the magnitude is a threshold. 

4. The method of claim 1. wherein the category is a bin. 

5. The method of claim 1. wherein each value of a sequence of values is a bit. 
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4 The meth od of claim 1, wherein at least one of the first sequence of values and the 

second sequence of value is data from a histogram. 

7. The method of claim 6. wherein the histogram is a color histogram. 

8^ The met hod of claim 1. wherein in the order of values of both the first sequence of 

values an d die second sequence of values, values associated widi the same magnitude are 
grouped together in groups. 

9. The method of claim 8. wherein the order of the groups is according to resolution of 
information of each value of each group. 

10. The method of claim 1, wherein in the order of values of both the first sequence of 
values and the second sequence of values, each value is associated with a resolution equal to 
or higher than the preceding value. 

11. An apparatus configured to: 

receive a first sequence of values and a second sequence of values, wherein: 

each value of the first sequence and each value of the second sequence 
is associated with a categon^ and a magnitude, and 
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in the order of values of both the first sequence of values and the 
second sequence of values, no adjacent values have the same category. 

12. The apparatus of claim 11. configured to cotnpare a value of the first sequence with a 
value of the second sequence if the value of the first sequence and the value of the second 
sequence are associated with the same category and same magnitude. 

13. The apparatus of claim 11, wherein the magnitude is a threshold. 

14. The apparatus of claim 11. wherein the category is a bin. 

15. The apparatus of claim 11. wherein each value of a sequence of values is a bit. 

16. The apparatus of claim 11. wherein at least one of the first sequence of values and the 
second sequence of value is data from a histogram. 

17. The apparatus of claim 16. wherein the histogram is a histogram. 
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18. The apparatus of claim 11. wherein in the order of values of both the first sequence 
of values and the second sequence of values, values associated with the same magnitude are 
grouped together in groups. 

19. The apparatus of claim 18. wherein the order of the groups is according to resolution 
of information of each value of each group. 

20. The apparatus of claim 11. wherein in the order of values of both the first sequence 
of values and the second sequence of values, each value is associated with a resolution equal 
to or higher than the preceding value. 
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ABSTRACT OF THE DISCLOSURE 

Th e pr e s e nt invention r e lat e s to a multimedia qu e ry using a color histogram, and mor e 

particularly, to a method for configuring a color histogram which provides interop e rability 

b e tw ee n color histograms configur e d by non uniform bin quantization using bits of a diff e r e nt 

numb e r, and provides progressive bit proc e ssing for k ee ping a constant performanc e e v e n wh e n 

using th e front parts of total bits of e ach bin valu e in th e ord e r of tim e seri e s. 

A eolor hi s togram includes threshold value s u s ed in repre s enting the number of n of bits 
for s ecuring interopcrabilit>,, capable of comparing the hi s togram s represented by th e 
number of bits which arc differ from each oth e r, including nece ss arily thre s hold valu e s 
u s ed in representing the number of N'(N'<N) of bit s , when bin value i s repre s ented with 
the number of N of bits by quantization in order to query multimedia using color 
histogram. Al s o, the color hi s togram includes n th bit repr es ented by quantization of bin 
value, wherein the nth bit bi s ects the re s pective region s divided into (N - l)th bit in ord e r to 
perform a progres s ive bit processing capable of retrieving by using only a bit, which is 
smaller than N, when bin value is represented with the number of N of bits by quantization 
in ord e r to qnory multimedia u s ing color histogram. Embodiments of the present invention 
relate to a method for receiving a first sequence of values and a second sequence of values. 
Each value in the first sequence and each value in the second sequence is associated with a 
category^ and a magnitude. In embodiments of the present invention, the magnitudes are 
partial. In embodiments of the present invention the categories are bins. In embodiments 
of the present invention each value of a sequence is a bit. In the order of the values of both 
the first sequence of values and the second sequence of values, no adjacent bodies have the 
same category. Accordingly, in embodiments of the present invention, when a histogram is 
transferred or received for analysis, the order of the information in the histogram can be 
strategically ordered to increase compatibility of histograms and utilize partials of histograms 
in an image search. 
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